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INTRODUCTION 


Problem  Description 


There  are  many  important  problems  in  the  field  of  communications 
theory  that  have  as  their  solution  the  expectation  of  a random  variable. 
Perhaps  the  classic  example  of  such  a problem  is  that  of  computing  the 
probability  of  bit  error  for  a binary  signal  being  transmitted  on  a channel 
with  linear  intersymbol  interference  Cl]  - Cl5].  A block  diagram  for  this 
example  is  given  in  Figure  1.1. 


Binary 
Source 
a.e  I ±1| 


Channel 


Receiver 


Figure  1.1 


The  binary  source  selects  a value  for  a.  with  equal  probability 
each  T seconds.  These  source  symbols  are  encoded  into  waveforms 
suitable  for  transmission  across  the  channel.  The  time  function  x(t) 
represents  a string  of  these  channel  waveforms.  The  channel  is  assumed 
to  act  upon  the  waveform  string  x(t)  as  a linear  filter.  Thus,  the  waveform 
associated  with  a particular  source  symbol  will  typically  be  distorted  in 
shape  and  spread  in  time  by  the  action  of  the  channel.  Let  the  distorted 
waveform  string  at  the  channel  output  be  represented  by  y(t).  This 
signal  is  assumed  to  be  further  distorted  by  the  addition  of  a white 
Gaussian  noise  process,  that  is  denoted  by  n{t).  The  waveform  string 
finally  presented  to  the  receiver  is  r(t)  where 


r(t)  = y{t)  + n(t). 


(1.1) 


This  signal  is  detected  and  sampled.  The  sampled  output  at  time  zero 
can  be  represented  by 


r = a h 
o o 


IVl  ^ 

+ / a.h.  + n 

o . , i I c 


(1.2) 


i = -M 


where  r^  is  the  detected  and  sampled  output  at  time  i,  ...  ...  a_  ^ 

Bq  a^  ...  aj^  ...  is  the  binary  input  signal  string,  | b.  | is  the  sampled 
impulse  response  of  the  channel,  and  n^  is  the  Gaussian  noise  sample 
at  time  zero.  The  primed  summation  in  equation  (1.2)  is  a standard 
symbolism  for  a summation  that  is  missing  its  central  term.  It  is 
further  assumed  that  the  channel  impulse  response  has  only  2M  + 1 
significant  terms. 

The  probability  of  bit  error  at  time  zero  can  be  shown  C 1 1 ] to  be 
given  by  the  expressions 


= [ Q (- 

= («(- 


h + u 


h + u 

o ' ' 


) +o( 


h - u 
o ' ' 


(1.3a) 


(1.3b) 


where 


w 

Q(x)  = f exp(-y^/2)  dy, 

\fZrT  * 


iVl 

I a.h.. 
: a I I 


(1.4) 


(1.5) 


i=-M 


a is  the  standard  deviation  of  the  Gaussian  noise,  and  U represents  the 

space  of  all  strings  of  2M  binary  symbols.  The  expressions  (1.  3a)  and 

(1 . 3b)  are  clearly  equal  mathematically,  but  it  has  been  shown  C 1 1 ] 

that  one  form  or  the  other  can  have  analytical  advantages  when  evaluating  the 

probability. 
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Unfortunately,  the  expressioi\s  in  equations  (1.  la)  and  (1.3b) 

may  be  difficult  or  computationaly  impractical  to  solve  exactly.  For 

example,  if  the  interymbol  interference  extends  for  forty  samples 

preceeding  and  trailing  the  actual  signal  sample  time  {M-40),  the  exact 

evaluation  of  the  probability  of  error  would  involve  the  summation  of 

2^^  w 10^^  terms  of  the  form  of  equation  (1.4.).  Thus,  even  if  equation 

(1.4)  could  be  solved  in  1 nanosecond  of  comp>iter  time,  exact  computation 

5 

of  P would  require  3x10  centuries.  Although  channels  having  an  impulse 
e 

response  that  is  significant  over  80  bit  times  may  be  rare,  it  is  clear  that 
the  computation  involved  in  calculating  (1.  3a)  or  (1.  3b)  can  still  be  large 
even  for  fairly  modest  impulse  responses. 

Expressions  similar  to  (1.  3a)  can  be  derived  for  the  probability 
of  bit  error  on  any  additive  Gaussian  noise  channel  with  linear  interference. 
Examples  would  include  spread  spectrum  multiple  access  channels,  and 
channels  with  co-channel  interference  LlO]  - Cl9].  Thus,  the  evaluation 
methods  that  will  be  discussed  below  are  more  generally  applicable  than  to 
just  intersymbol  interference  problems.  They  will  apply  to  Gaussian  channels 
with  other  kinds  of  linear  interference  as  well. 

1 . 2 Isomorphism  Theorem 

One  possible  approach  to  problems  in  communications  and  information 
theory  that  appear  difficult  or  impossible  to  solve  in  their  exact  form  is 
to  find  bounds  to  the  exact  solution  that  are  easily  computed.  One  technique 
that  has  been  proven  to  be  useful  in  providing  bounds  to  problems  of  this  kind 
is  the  Moment  Bounding  Technique  [ll]  - [19].  This  technique  is  based 
on  an  Isomorphism  Theorem  from  Game  Theory  [20],  [21].  In  this  approach, 
the  moment  of  the  function  of  the  random  variable  that  is  of  interest  is 
bounded  in  terms  of  moments  of  other  functions  of  the  same  random 
variable.  These  other  functions  are  chosen  such  that  their  moments  are 
relatively  easy  to  evaluate.  This  approach  has  the  unique  advantage  that 
both  upper  and  lower  bounds  can  be  found  with  the  same  computational 
technique.  In  addition,  the  moment  bounds  that  are  derived  using  two  or 
three  dimensions  yield  a relatively  simple  geometrical  understanding  of  the 
bounding  process. 
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The  Isomorphism  Theorem  can  be  stated  as  follows: 


Isomorphism  Theorem: 

Let  u be  a random  variable  with  probability  distribution  Gy(u) 

defined  over  a finite  closed  interval  I = [a,  b].  Let  (u),  • • • • 

k (u)  be  n continuous  functions  defined  on  I.  Let  m. , i = 1,  • • • , n,  denote  the 
n 1 

n generalized  moments  of  the  random  variable  u induced  by  the  functions 
1 k.(u)}. 


1.  = /j  k^(u)  d Gy(u)  = E^,rk^(u)], 


i = 1 , . . . , n 


(1.6) 


(1.7) 


Denote  the  moment  space  as 

= I IB  = > ‘^2’  * ■ • ’ "^n^  ® i 

where  Gy{u)  ranges  over  the  set  of  all  probability  distribution  functions 
defined  on  I.t  is  a closed,  bounded,  and  convex  set. 

Let  ^ denote  the  generalized  curve  £ = (r^,  r^ r^)  traced 

out  in  r”  by  r.  = k.(u)  for  u e I.  Let  ^be  the  convex  hull  of  ^ . Then 


The  application  of  the  Isomorphism  Theorem  to  bounding  problems 
can  be  seen  from  the  following  two  dimensional  (n  = 2)  example.  Given 
a function  kj(u)  of  the  random  variable  u whose  moment,  EyCkj(u)],  is 
desired,  select  a second  function,  k2(u),  whose  moment  is  easily  computable. 
By  identifying  the  functions  kj(u)  and  k^fu)  with  the  two  orthogonal  axes 
of  a two-dimensional  coordinate  system,  as  in  Figure  1.2,  a curve  ^ can 
be  traced  out  as  u varies  through  its  finite  range  of  values.  The  convex 
hull,  of  the  curve  ^ can  now  be  found,  as  in  Figure  1.3.  Let  m^  denote 

the  value  of  the  moment  of  the  function  k2(u)  as  in  (1.6).  According 
to  the  Isomorphism  Theorem,  the  set  of  all  moment  pairs 


= I (rrip  m^)  | m^  = ECkj(u)]  , m^  = ECk^  (u)]  } 


(1.8) 
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as  the  distribution  of  u varies  over  all  possible  distributions  defined  on  the 
range  of  u,  is  identical  to  the  convex  hull  . Thus,  from  Figure  1.4, 
upper  and  lower  bounds  to  the  exact  value  of  occur  at  the  points  where 
tlie  line  surface  of  the  convex  hull.  In  Figure  1.4, 

the  values  of  the  bounds  are  denoted  P and  P respectively. 

Most  of  the  applications  of  the  moment  bounding  techniques  to 
problems  in  communications  theory  have  used  two-dimensional  moment 
bounds  [8]  - [l3],  [l6]  - [19].  This  is  b ecause  two  dimensional  bounds 
arc  quite  intuitive  and  inherently  tractible  (they  can  always  be  found  graphically). 
The  following  chapters  are  an  extension  of  the  applications  of  the  moment 
space  bounding  technique  to  classes  of  higher-dimensional  bounds.  Higher 
dimensional  bounds  are  valuable  for  two  reasons.  First,  they  usually 
offer  tighter  bounds  than  those  that  can  be  computed  with  two-dimensional 
techniques.  Second,  in  some  cases  they  offer  bounds  that  are  as  tight  as 
the  best  two-dimensional  bounds  but  require  less  computational  effort. 

Thus  a higher-dimensional  moment  bounding  technique  offers  tigher  bounds, 
or  less  effort,  or  in  some  cases  both  tighter  bounds  and  less  effort  than  two- 
dimensional  bounds. 


II. 


THREE-DIMENSIONAL  MOMENT  BOUNDING  ALGORITHM 


f 


Z.  1 Introduction 

Most  of  the  research  effort  that  has  been  expended  on  applications 
of  the  moment  bounding  technique  [ill  - [l9]  has  been  expended  deriving 
exact  analytic  expressions  for  the  upper  and  lower  bounds.  The  forms 
of  the  expressions  for  the  bounds  are  typically  conditional  on  the  para- 
meters of  the  curve  ^ , and  on  the  values  of  the  auxiliary  moments. 

For  example,  consider  the  two-dimensional  intersymbol  interference 
moment  bound  results  reported  by  Yao  and  Tobin  [llj.  In  particular, 
consider  the  case  of  the  exponential  auxiliary  bounding  function.  The 
equations  for  the  curve  *^for  this  example  are 


i 

► 

I 

'i 


» 


♦ 


and 


c(h  + u) 
X - kj(u)  = e ° 


y = ~ erfc 


(*1.  1) 


(^.2) 


In  these  equations,  c is  an  arbitrary  constant,  erfc  (•  ) is  the  standard 
complementary  error  function,  u is  the  amount  of  intersymbol  interference, 
h^  is  the  amplitude  of  the  desired  signal,  and  a is  the  standard  deviation 
of  the  additive  white  Gaussian  noise.  As  is  demonstrated  in  [ll],  for 
given  values  of  h^  and  a and  given  limits  on  the  range  of  u,  the  curve 
will  vary  from  being  convex  , to  "S-shaped",  to  convex  U , 
depending  on  the  value  of  the  parameter  c in  (Z.  1).  Clearly  the  form  of 
the  analytic  expressions  for  the  boundry  of  the  convex  hull  generated  by  this 
curve  is  a function  of  the  parameter  c.  In  addition,  when  the  curve  ^ is 
"S-shaped",  the  form  of  the  bounding  expressions  will  depend  on  the  location 
of  the  bounds  on  the  surface  of  the  convex  hull.  This  is  to  say,  they  will 
depend  on  the  value  of  the  auxiliary  moment  m^  = EyCkj^Iu)]  of  equation 
(2.  1).  These  facts  are  illustrated  in  Figure  2.  1. 
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Figure  2.  1 


It  is  seen  in  Figure  2.  1 that  the  form  of  the  upper  bound  will  be  linear 
in  the  region  kj^)  of  the  abscissa,  but  will  take  on  the  form  of 

C/y  5}f  (m3.x) 

the  curve  ^ in  the  region  (k^,  k^  ).  Thus,  the  equations  for  the  bounds 
derived  using  the  moment  bounding  technique  are  not  typically  of  a single 
form,  but  are  composites,  strongly  dependent  on  the  parameters  of  the 
bound. 


From  the  standpoint  of  a casual  user  of  the  bounding  technique, 
the  composite  nature  of  the  bounding  equations  is  inconvenient.  It  would 
be  more  convenient  if  some  sort  of  unified  computational  approach  were 
found.  Such  an  approach  would  eliminate  the  need  to  make  detailed 
preliminary  investigations  into  the  local  geometry  of  the  curve  ^ and 
its  convex  hull  The  bounding  technique  could  then  be  used  more 

easily  on  a broad  spectrum  of  bounding  problems. 

An  algorithmic  approach  is  such  a unified  approach.  In  such  an 
approach,  the  curve  ^ is  represented  in  a computer  as  an  array  of 
points.  This  array  is  a set  of  samples  taken  in  some  systematic  manner 
along  the  length  of  . The  algorithm  would  then  construct  the  convex 
hull  of  this  set  of  samples.  The  values  of  the  bounds  could  then  be  computed 
by  operating  on  this  modified  hull. 


The  algorithmic  approach  derives  its  unifying  properties  from 
the  fact  that  it  deals  with  an  array  of  sample  points  taken  from  the  curve, 
rather  than  dealing  with  the  smooth  curve  itself.  This  is  equivalent  to 
replacing  the  curve  ^ with  a piecewise  linear  approximation  to  . 

In  three-dimensions  the  convex  hull  generated  by  this  approximation  will 
always  be  a polyhedron.  The  hull  generated  by  the  original  curve  could 
have  been  any  three-dimensional  convex  figure.  Evaluating  the  bounds 
then  reduces  to  finding  the  anpropriate  planar  faces  of  the  polyhedron,  and 
then  computing  the  coc*  values  of  the  appropriate  points  on  these 

faces.  This  general  procedure  is  independent  of  both  the  shape  of  the  curve 
^ and  of  the  local  properties  of  the  original  convex  hull  eT,  generated 
by  ^ . 


In  the  following  sections  an  algorithm  is  presented  that  will 
compute  the  upper  and  lower  moment  bounds  for  the  three-dimensional 
moment  bounding  problem.  It  will  be  shown  that  the  algorithm  is  reasonably 
modest  in  its  use  of  central  processor  (cpu)  time  for  a representative 
example.  Both  a general  description  of  the  procedure  and  a listing  of  an 
actual  implementation  will  be  presented.  The  technique  is  based  on  the  work 
of  Appel  and  Will 
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It  is  noted  that  this  procedure  computes  an  approximation  to 
the  moment  bounds.  There  are  two  responses  to  this  observation.  First, 
since  the  curve  ^ is  assumed  to  be  smooth  and  of  finite  length,  the 
sample  points  in  the  array  can  be  chosen  to  be  sufficiently  dense  to  assure 
that  the  results  will  approximate  the  true  value  of  the  bounds  to  any  required 
accuracy.  Secondly,  the  algorithmic  solutions  can  be  adjusted  to  lie  out- 
side the  original  bounds.  A method  of  computing  the  adjustments  will  be 
presented  below.  Thus,  the  adjusted  approximations  will  always  be  valid 
bounds.  With  the  adjustments  they  will  not  be  as  tight  as  the  exactly  computed 
moment  bounds,  but  the  adjustments  can  be  made  arbitrarily  small  by 
making  the  sample  points  sufficiently  dense. 


The  arguments  concerning  the  adjustments  to  the  algorithmic 
solutions  are  as  follows.  By  the  definition  of  the  convex  hull  of  a curve, 
the  hull  generated  by  any  piecewise  linear  approximation  to  the  curve 
^ will  be  interior  to  the  hull  generated  by  ^ itself.  Thus,  as  the  number 
of  sample  points  of  ^ increases,  the  hull  of  the  approximation  will  approach 
the  original  hull,  from  the  inside. 


^ Denote  the  piecewise  linear  approximation  to  the  curve  ^ by 

^ . Let  5 (p)^be  the  minimum  Euclidean  distance  from  point  p on  the 
curve  ^ to  ^ . Let  h be  the  largest  such  distance  for  any  p on  ^ . 
Denote  the  convex  hull  generated  by  ^ as  . Consider  the  polyhedron 

that  is  ■Imllar^  to  e/T  but  at  a minimum  Euclidean  distance  of  5 to 
the  outside  of  Tha^  is,  the  polyhedron  that  has  planar  faces  parallel 

to  the  planar  faces  of  Clearly,  the  original  curve  ^ must  be 

interior  to  this  new  polyhedron.  Similarly,  the  original  convex  hull 

must  be  interior  to  this  new  figure.  Therefore,  if  the  upper  bound 
computed  by  the  algorithm  is  increased  by  an  amount  and  tlie  lower 
bound  decreased  by  6,  the  resulting  numbers  are  guaranteed  to  be  true 
bounds  to  the  desired  moment. 
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i.,  Z Preliminary  Definititjns 

Let  A denote  a three-dimensional  array  containing  a finite 

number  of  elements.  These  elements  may  be  thought  of  as  being  the 

coordinate  values  of  sample  points  of  a smooth  twisted  curve  ^ in  e\ 

Let  denote  the  three-dimensional  convex  hull  generated  by  A.  Let  F 

denote  a plane  and  denote  the  usual  orthogonal  projection  operation 

3 ^ 

from  E onto  F.  Then  there  is  an  array  A on  the  plane  F such  that 


(2.3] 


The  array  Ap  is  the  projection  of  the  array  A onto  the  plane  F. 

Let  tlie  convex  bull  of  the.  set  Ar-.  be  denoted  by  JT  A basic 

F F 

property  of  convex  bodies  can  be  stated  as 


(2.4) 


This  is  to  say,  the  convex  hull  of  a projection  (A„  is  the  projection  of  A) 

r 

is  equal  to  the  projection  of  the  convex  hull.  This  property  is  fundamental 
to  several  different  algorithms  (e.  g.  , [26],  [27] ) that  compute  three- 
dimensional  convex  hulls.  It  will  also  be  basic  to  the  algorithm  developed 
below. 


The  property  that  is  expressed  as  equation  (2.4)  will  be  used 
to  reduce  the  problem  of  determining  the  structure  of  a three-dimensional 
convex  hull  into  a sequence  of  two-dimensional  convex  hull  problems. 
There  are  satisfactory  computational  methods  known  for  finding  the  convex 
hulls  of  two-dimensional  arrays  [26]  - [29].  A modified  version  of 
one  of  these  methods  [26]  will  be  used  in  the  development  of  the  algorithm 
that  follows. 
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The  convex  hull  of  a finite  element  two-dimensional  array 
will  be  a convex  polygon,  ^F-  The  sides  of  this  polygon  will  be  chords 
connecting  members  of  the  set  Ap.  These  chords  are  shown  by  equation 
(2.4)  to  be  the  F-plane  projections  of  chords  joining  points  of  the  array 
A that  are  on  the  surface  of  ^ in  E^.  Thus,  if  there  are  a finite  number 
of  elements  in  the  array  A,  there  must  be  a finite  length  sequence  of 
projection  planes  j j that  will  allow  the  i^ntification  of  the  entire 
network  of  chords  that  lie  on  the  surface  of  ,ye.  This  network  can  be  seen 
to  define  the  planar  faces  of  the  polyhedral  convex  hull  . Therefore, 
the  network  effectively  defines  the  entire  surface  of  Jt  . 


One  method  of  constructing  a sequence  of  proje^ion  planes 
j F j involves  the  "collapsing"  of  surface  chords  of  . This 
method  is  developed  in  [26],  and  is  the  method  that  is  used  in  the  al- 
gorithm presented  here.  In  this  method,  an  arbitrary  first  p^mjection 
plane  Fj^  is  selected  and  the  corr espoinding  projected  hull  fJt  P^  is 

determined.  A boundry  chord  of  is  selected  in  some  systematic 

^1 

manner.  Denote  the  selected  chord  by  Chp  . The  chord  Chp  is  the 


Fj-pj^ane  projection  of  a chord  (to  be  denoted  Ch^  that  is  on  the  surface 
of  jr  in  E^.  The  next  projection  plane  in  the  sequence,  F^.  is  chosen  to 
be  orthogonal  to  the  chord  Chp  Thus,  the  chord  Ch^  projects  as  a single 
point  on  F^.  In  the  F^  projection,  the  chord  Ch^  is  said  to  be  "collapsed.  " 
This  procedure  can  be  implemented  as  a rotation  of  the  points  in  the  set 
A about  a suitable  axis,  denoted  For  a given  set  of  coordinate  axis 

and  a given  projection  plane  F,  the  points  in  A are  rotated  such  that 
the  chord  Chj  projects  as  a point  on  the  projection  plane  F.  The 
algorithm  that  is  presented  below  uses  this  procedure. 


The  present  algorithm  is  an  adaptation  of  an  algorithm  developed 
by  Appel  and  Will  [26].  Appel  and  Will’s  algorithm  finds  the  convex 
hull  of  a three-dimensional  array  of  points  by  the  method  of  "collapsed" 
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chords,  as  was  discussed  above.  The  present  algorithm  differs  from  that 
of  [26]  mainly  in  that  the  bounding  problem  requires  knowledge  of  only 
two  regions  on  the  surface  of  while  the  algorithm  given  in  I 26] 

provides  a description  of  the  entire  surface.  The  present  algorithm  attempts 
to  converge  quickly  to  the  regions  on  the  surface  of  Jv  of  interest,  at 
the  expense  of  the  knowledge  of  the  over-all  shape  of  the  hull.  This  is 
appropriate  because  the  additional  information  would  not  be  relevant 
to  the  bounding  problem  at  hand. 
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Problem  Statement 


Consider  the  twisted  curve  ^ defined  in  terms  of  the  parameter 


u by  the  equation  set 


X = h(u) 


y = g(u) 

z = f(u) 


uel  = [a,  b] 


(2.5) 


where  I is  the  finite  interval  of  definition  of  ^ . The  functions  h(u), 
g(u),  and  f(u)  are  assumed  to  be  continuous  and  finite  valued  on  I.  The 
elements  of  the  triple  (x,  y,  z)  can  be  associated  with  the  coordinate  axes 
of  a standard  right  handed  coordinate  system.  The  curve  ^ is  traced 

3 

out  in  E as  u covers  its  interval  of  definition  I. 

3 

Consider  the  line  in  E defined  by  the  equation  set 


X = m^  = EyCh(u)] 


y = m^  = EyCg(u)] 


where  the  notation  EyC*  ] represents  the  expectation  with  respect  to  the 
random  variable  u.  Let  the  line  of  equation  set  (2.  6)  be  denoted  by  1. 

A consequence  of  the  isomorphism  theorem  [ll]  is  that  i passes 
through  the  convex  hull  generated  by  the  curve  ^ . A further 
consequence  is  that  the  quantity 

m3  = EyLf(u)] 

is  upper  and  lower  bounded  by  the  points  on  the  surface  of  ^ where 

is  penetrated  by  the  line  1.  This  amounts  to  an  informal  statement 
of  the  moment  bounding  theorem. 


(2.6) 


(2.7) 
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The  purposes  of  the  moment  bounding  technique  are  served 
by  the  evaluation  of  the  surface  of  the  hull  at  the  two  locations  where  the 
surface  is  penetrated  by  the  line  f.  Thus,  when  the  hull  ^is  approximated 
by  the  polyhedron  the  modified  bounding  problem  requires  only  the 

identification  of  the  two  planar  faces  where  the  line  I penetrates  the 
polyhedron  The  algorithm  to  be  described  identifies  these  faces 

as  the  result  of  a directed  search  routine.  This  routine  uses  a sequence 
of  planar  projections  generated  by  "collapsing"  a sequence  of  surface 
chords. 


15 


(■ 


» 


f 


♦ 


<i.  4 The  Algorithm 

This  is  an  outline  of  an  algorithm  that  computes  the  lower 
bound  given  by  the  moment  bounding  technique.  The  modifications  to 
the  algorithm  that  are  required  to  compute  the  upper  bound  should  be 
clear  from  the  discussion.  The  algorithm  is  shown  in  block  diagram 
form  in  Figure  2.2. 


Step  1:  Initialization 


Given  the  set  A = (x,  y,  z)  | x = h{u.),  y = g(u  ),  z = f(u  ); 

I I ^ ^ ^ 

u^€l  = [a,  b],  a,  b < i = 1,  * ' ' , N » j and  the  line  I,  given  by 

equation  set  (2.6),  consider  the  x-y  plane  to  be  the  first  projection  plane 

F,.  Let  denote  the  F,  plane  projection  of  the  line  1.  Consider  the 
1 F^  1 


projected  set  Ap  , the  F^ 

possible  set  A_  and  line 
^ 1 

visualizing  the  situation. 


plane  projection  of  the  set  A.  A sketch  of  a 

I are  presented  as  Figure  2.3  as  an  aid  in 
^1 


i 
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Let  JC  denote  the  convex  hull  of  the  planar  set  A . In  Figure  2.  3 

the  boundry  of  has  been  dashed  in  and  designated.  It  can  be  seen 

^ 1 ^ 


that  the  line  cuts  the  boundry  of  in  exactly  two  places.  Let 

•^1  1?  » 


Chj,  denote  the  chord  that  forms  the  boundry  of 


at  the  lower  of 


these  two  cuts.  The  chord  Chp  is  designated  in  Figure  2.3.  A subroutine 
for  finding  the  chord  Ch  is  described  in  detail  in  Appendix  A. 


Denote  the  left  end  point  of  Ch„  by  p . Denote  the  right 

■^1  1 

R ^ ^ 

end  point  by  Pp  . The  designations  are  shown  in  Figure  2.  3.  By  the 

^ L R 

construction  of  Ap,  . p„  and  Pp,  are  projections  of  points  in  the  set  A. 

1 ^1  ^1 

L R 

Denote  these  points  pj  and  p^  respectively.  Let  Ch^  denote  the  chord 
L R 3 

connecting  p^  and  p^  in  E . By  the  arguments  of  the  previous  section, 

since  Ch„  is  a chord  on  the  surface  oftJ^  , Ch,  is  a chord  on  the  surface 
^ 1 ^1  ^ 
of  jr  , the  convex  hull  of  the  set  A. 


Denote  the  point  of  intersection  of  the  line  and  the  chord 

C i 

Chp  by  Pp  , as  shown  in  Figure  2.  3.  Clearly  there  is  a point  on  the  line 

^ ^ C C 

I in  E-^  whose  projection  is  the  point  p . Denote  this  point  by  p,  . Initialize 

^1  ^ 

the  step  index,  i = 1.  This  complets  the  initialization  of  the  algorithm. 

Step  2:  Rotation 

L»  C R 

Consider  the  plane  defined  by  the  three  points  (p.  , p.  , p.  ) 

3 i i i 

in  E . Consider  the  line  that  is  normal  to  this  plane  and  intercepts  the  plane 

Q 

at  the  point  p.  . This  line,  denoted  will  be  used  aS  an  axis  of  rotation 
I R 

for  the  points  in  the  set  A and  the  line  1.  Rotate  all  points  about 

with  respect  to  the  established  (x,  y,  z)  coordinate  system  until  the  chord 

Ch.  is  "collapsed"  (projects  as  a point  on  the  x-z  plane).  Arguments 

establishing  that  this  particular  rotation  will  "collapse"  the  chord  Ch. 

are  presented  in  Appendix  B.  The  new  x-z  plane  projection  is  a consequence 

of  the  rotation  is  the  F.  ^ j plane  projection.  Increment  the  step  index  i. 
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Step  3:  Branchinjj 

Find  the  next  chord  Ch.  by  the  methods  of  step  1.  Find  the  next 

C * 

point  p.  . 

A)  If  the  chords  Ch.  and  Ch.  _ ^ are  connected  (have  an  end 
point  in  common),  go  to  step  4. 

Q 

B)  If  chords  Ch.  and  Ch.  , are  not  connected,  and  p.  ^ 

1 1-1  *^i 

C 

p^  go  to  step  3. 

C)  Otherwise,  to  to  step  6. 

Step  4:  Triangular  Section 

The  two  connected  chords,  Ch.  and  Ch.  ^ define  a triangular 

planar  section  on  the  surface  of  If  a point  of  the  line  I is  also  a 

point  of  this  triangular  section,  this  point  is  the  bounding  point  that  is 

C 

desired.  This  is  the  point  denoted  p.  . Terminate  the  procedure. 

If  the  line  i and  the  triangular  section  have  no  points  in  common,  determine 
which  of  the  three  chords  that  bound  this  triangular  planar  section  is  closest 

(3 

to  the  point  p^  in  Euclidean  distance.  Change  the  labeling  such  that  this 

closest  chord  is  designated  as  the  chord  Ch.,  and  its  end  points  are  designated 
R.  ^ 

p.  and  p.  . Return  to  step  Z.  The  procedures  presented  in  this  step  are 
detailed  and  justified  in  Appendix  C. 


Step  5:  Continue 


Return  to  step  Z with  the  chord  Ch.  and  the  point  p.  that 


were  found  in  Step  3. 
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Step  6:  Quadrilateral 

o*  C _ C , *.  • 1 / -^  ^ H\  j ^ ^ 

Since  Pj,  “ Pj  _ p both  triples  (p^  , p^  , p.  ) and  (p^  j,  p. 

R 

p^  _ j)  define  the  same  plane.  In  this  case,  chords  Ch.  and  Ch.  ^ are 

segments  of  the  boundry  of  a section  of  this  plane  that  is  on  the  surface  of 

Since  Chj^  and  Chj^  ^ are  co-planar  but  disconnected,  a quadrilateral 
may  be  formed  by  joining  appropriate  pairs  of  end  points  of  these  chords. 

If  the  line  I and  this  quadrilateral  planar  section  have  a point  in  common, 
this  point  is  the  bounding  point  that  is  desired.  This  point  is  the  point  that 

Q 

has  been  denoted  p^  . Terminate  the  search  procedure.  If  the  quadrilateral 
planar  section  and  the  line  I have  no  points  in  common,  determine  which 
of  the  four  chords  that  form  the  boundry  of  the  quadrilateral  is  closest  in 

Q 

Euclidean  distance  to  the  point  Pj^  . Change  the  labeling  such  that  this 

closest  chord  is  designated  as  the  chord  Ch.,  and  its  end  points  are 
L R 

designated  pj^  and  Pj^  . Return  to  step  Z.  The  statements  are  procedures 
presented  in  this  step  are  detailed  and  justified  in  Appendix  D. 


I 
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2.  5 


Examples  of  Numerical  Results 


The  algorithm  outlined  in  Section  2.  4 has  been  coded  for  general 
purpose  computers  using  the  FORTRAN  IV  programming  language.  A 
print  out  of  the  program  is  provided  as  Appendix  F.  Two  sample  runs 
were  made  using  this  program.  The  results  of  the  first  will  be  presented 
in  detail  in  this  section.  The  second  will  be  presented  in  conjunction  with 
the  results  of  the  four-dimensional  algorithm  described  in  the  next  chapter. 


The  examples  are  intersymbol  interference  problems.  The 
auxiliary  functions  used  for  the  bounds  are  the  second  and  fourth  powers 
of  the  amplitude  of  the  interference.  The  parametric  equations  for  the 
Curve  ^ in  are  th« 


len 


X = u 


y = u 
1 


q' 

V / 

_ 

Q 


h - u 
o 


(^.8) 
(2.9) 
(2.  10) 


whc;re  u is  the  amplitude  of  the  int<'fsymbol  interference,  h^  is  the  amplitude 


of  the  desired  signal,  a is  the  standard  deviation  of  the  additive  white 
Gaussian  noise,  and  Q(.  ) is  the  usual  complementary  error  function  given 
by 


Q{y) 


1 


\fz^ 


1 2 

e dx. 


(2.  II) 


This  is  the  three-dimensional  extension  of  an  intersymbol  interference 
problem  treated  by  Yao  and  Tobin  1.11]  and  Yan  [12].  The  range  of  the 
parameter  u is 


0 i u - D ^ h 
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(2.  12) 


relation  (2.  12)  implies  that  the  intersymbol  interference  "eye"  is  open. 

This  means  that  if  the  channel  were  noise  free,  perfect  communication 
would  be  possible  inspite  of  the  intersymbol  interference.  This  is  true 
because  the  amplitude  of  the  desired  signal,  h^,  is  strictly  greater  than 
the  maximum  interference  D.  This  is  a characteristic  of  a useful  com- 
munication channel. 

The  first  specific  example  is  that  of  a channel  with  Chebychev 
filter  frequency  characteristics.  This  is  a channel  that  is  commonly  used 
in  comparing  bounding  methods  in  intersymbol  interference  channels.  The 
characteristics  of  this  channel  are  given  in  detail  in  [llj  and  [12].  The 
algorithmic  results  that  are  presented  as  Table  2.  1 were  obtained  by 
approximating  the  curve  ^ with  an  array  A made  up  of  50  points  that 
were  equally  spaced  in  terms  of  the  parameter  u.  The  exact  results 
presented  in  Table  2.  1 were  computed  using  the  regularity  condition  results 
presented  in  [34],  It  was  shown  in  [34]  that  the  regularity  condition  held  for  the 
values  of  signal-to-noi  se  ratio  that  are  shown  in  Table  2.  1 for  the  Chebychev 
chann  el. 

It  can  be  seen  from  the  Table  that  the  algorithmic  values  are  very 
close  to  the  exact  values  of  the  bounds  for  low  and  intermediate  values 
of  signal-to-noise  ratio.  It  is  noted  that  the  algorithmic  values  are  not 
typically  interior  to  the  exact  bounds  as  was  theoretically  predicted. 

This  can  be  attributed  to  cumulative  round-off  and  truncation  errors  in  the 
particular  implementation  of  the  algorithm  that  was  used  in  these 
computations.  The  specific  implementation  that  was  used  in  obtaining  the 
results  of  Table  2.  1,  was  written  to  prove  the  validity  of  the  concepts 
of  the  procedure.  It  was  not  optimized  in  terms  of  either  cumulative  compu- 
tational errors  or  run  time.  In  spite  of  this,  most  of  the  results  are  seen 
to  be  accurate  to  four  significant  figures.  Furthermore,  the  typical 
computation  required  only  three  iterations  of  the  algorithm  to  obtain 
convergence,  and  required  less  than  0.022  sec  of  central  processor  (CPU) 
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SNR  Exact  Algorithmic  Exact  Algorithmic 

dB  Lower  Lower  Upper  Upper 

Bound  [34]  Bound  Bound  [34]  Bound 


time  on  a CDC  7600  computer.  With  greater  attention  to  program  optimization, 
in  terms  of  run-time  and  computational  accuracy,  these  statistics  may  be 
improved.  However,  it  is  clear  froin  this  example  that  this  algorithm 
yields  reasonably  accurate  results  with  a modest  investment  in  computation 


time. 


The  second  example  is  a modified  version  of  the  Chebychev 
channel  that  was  examined  in  the  first  example.  In  the  present  case, 
the  value  of  the  maximum  distortion,  denoted  by  D in  expression  (2.  12), 
is  increased  to  three  times  that  of  the  regular  Chebychev  channel.  The 
channel  impulse  response,  and  other  appropriate  parameters  are  scaled 
accordingly.  As  was  the  case  in  the  previous  example,  the  second  and 
fourth  powers  of  the  parameter  u were  used  as  the  auxiliary  functions. 


This  second  case  is  an  example  of  a channel  with  severe 
intersymbol  interference.  The  maximum  interference  D is  85%  of  the 
amplitude  of  the  desired  signal,  h^.  Unfortunately,  the  regularity  condition 
results  presented  in  il34j  cannot  be  used  to  compute  exact  bounds  to  this 
problem  for  all  s ignal-to-noise  ratios  of  interest.  Therefore,  a table 
similar  to  Table  2.  1 cannot  be  presented.  The  results  of  this  example 
are  presented  in  Table  3.2  in  Chapter  III  as  a part  of  a comparison  between 
this  three-dimensional  and  a four-dimensional  algorithm. 

From  the  stand  point  of  computational  complexity,  it  is 
interesting  to  consider  the  effect  on  run  time  of  varying  the  number  of 
points  contained  in  the  array  A.  It  can  be  seen  from  inspection  of  the  al- 
gorithm outline  (Section  2.4)  and  the  printout  of  the  actual  program 
(Appendix  F)  that  the  algorithmic  steps  most  effected  by  the  size  of  the 
array  A are  the  "collapsing"  or  rotation  procedures  and  the  procedures 

that  find  the  chords  Ch„.  Clearly,  the  complexity  of  the  rotation  procedure 

r 

is  linear  in  the  number  of  points  in  A.  If  s seconds  are  required  to  rotate 


f 


r 


a single  point,  roughly  ns  seconds  will  be  required  to  rotate  n points. 

The  change  in  complexity  o£  the  chord  finding  routine  is  less  clear. 

The  routine  will  typically  converge  to  the  desired  chord  in  a small  number 
of  iterations.  This  number  will  usually  be  essentially  independent  of  the 
number  of  points  in  A.  In  this  case,  the  chord  finding  routine  would  also 
be  linearly  complex  in  the  number  of  points  in  A.  However,  in  very  poorly 
conditioned  situations,  the  routine  may  be  able  to  eliminate  only  a single 
point  from  further  consideration  per  iteration.  In  this  extreme  case, 

- 1 r . N - 2)  (Z. 

i = 2 

iterations  of  the  routine  would  be  required  to  select  the  appropriate  two 
points  out  of  the  N points  in  the  array.  Thus,  in  practice  the  chord  finding 
routine  may  be  expected  to  behave  linearly  with  the  number  of  points  in 
the  array  A.  In  the  worst  possible  case  it  would  behave  quadratically  with 
the  number  of  points.  Therefore,  the  increase  in  algorithmic  complexity 
with  an  increase  in  the  number  of  points  in  the  array  A is  manageable. 

A linear  increase  is  slow  enough  to  assure  that  the  number  of  points  in 
A can  be  made  large  enough  to  yield  sufficiently  accuracy  results  without 
causing  and  unreasonable  increae  in  algorithm  run  time. 


III.  FOUR  AND  HIGHER  DIMENSIONAL  MOMENT  BOUNDING 

ALGORITHMS 

3. 1 Introduction 

In  Chapter  II  an  algoritlimic  solution  to  the  three-dimensional 
moment  bounding  problem  was  demonstrated  to  be  feasible  and  useful. 

The  next  obvious  question  would  be  whether  an  algorithmic  approach  could 
be  used  to  compute  higher  dimensional  bounds.  Higher  dimensional  bounding 
is  desirable  because  it  promises  tighter  bounds  than  otherwise  achievable. 
However,  the  evaluation  of  higher  dimensional  bounds  by  geometric 
arguments  based  on  the  Isomorphism  Theorem  appears  to  be  extremely 
difficult.  Furthermore,  the  evaluation  of  bounds  of  this  type  does  not  seem 
to  have  been  considered.  Some  non- geometric  approaches  have  been 
considered  ([  14] , [15]).  Thus,  an  algorithmic  approach,  such  as  was 
developed  for  the  three-dimensional  case  in  Chapter  II,  may  prove  to 
be  a useful  tool  in  computing  tight  bounds  for  general  classes  of  auxiliary 
functions  based  on  higher  dimensional  moment  bounding  theory.  In  this 
chapter,  an  algorithm  is  developed  that  will  solve  the  four-dimensional 
moment  bounding  problem  for  a very  general  class  of  auxiliary  functions. 

The  algorithm  has  not  been  optimized  in  any  computational  sense,  but 
has  the  advantage  of  relative  conceptual  simplicity.  Furthe'rmore,  it  will 
be  shown  to  be  easily  extendable  to  problems  of  higher  dimensionality  than 
four. 

3 . Z Preliminary  Discussion 

The  convex  hull  , of  an  array  A,  containing  a^inite  number 
of  points  in  is  an  n-dimensional  polyhedron.  That  is,  is  a convex 

figure  whose  major  surface  features  are  sections  of  (n- 1 )-dimensional 
hyperplanes.  In  the  four-dimensional  case,  these  three-dimensional  sections 
are  defined  by  sets  of  four  points  of  A.  The  solution  to  the  moment  bounding 
problem  amounts  to  finding  the  two  four-point  sets  that  define  the  surface 
of  the  convex  hull  at  the  places  where  it  is  penetrated  by  the  line  i.  Except 
for  the  number  of  points  involved  in  the  surface  definition  (four  instead  of 
three),  this  statement  of  the  problem  is  identical  to  that  of  the  three- 
dimensional  problem  that  was  treated  in  Chapter  II. 
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Unfortunately,  the  four- dimensio nal  problem  does  not  appear 

to  yield  to  the  same  sort  of  intuitive  solution  that  was  used  in  the  three- 

dimensional  case.  In  particular,  the  notion  of  an  orthogonal  projection  onto 
2 4 

a plane  (E  ) is  not  well  defined  in  . Therefore,  chord  "collapsing" 
in  a plane  is  meaningless  in  the  sense  that  it  was  used  in  Chapter  II. 

The  algorithm  that  will  be  presented  below  makes  use  of  two 
general  properties  of  n-dimensional  convex  figures  [22],  ^31]  - t33^. 

The  first  of  these  properties  is  that  the  intersection  of  a convex  hull  and 
a closed  half  space  is  also  a convex  hull.  The  second  property  is  that  if 
a point  in  e”  is  exterior  to  a convex  hull  in  E*^,  there  is  a (not  necessarily 
unique)  support  or  tangential  hyperplane  to  the  hull  that  separates  the  point 
and  the  hull  into  different  half  spaces.  These  two  properties  are  used 
in  the  algorithm  to  separate  the  points  in  the  set  A into  two  subsets.  This 
separation  allows  the  algorithm  to  be  assured  of  proceeding  in  the  direction 
of  the  desired  surface  feature.  The  exact  implementation  of  this  search 
procedure  will  be  detailed  in  the  presentation  of  the  algorithm. 
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3.  3 The  Algorithm 

This  section  is  an  outline  of  an  algorithm  that  solves  for  the  lower 
bound  for  the  four-dimensional  moment  bounding  problem.  The  extensions 
of  this  algorithm  to  include  the  upper  bound  or  higher  dimensional  problems 
will  be  apparent. 

Step  1:  Initialization 

Given  the  set  A and  the  line  I,  consider  the  three- 
4 

dimensional  subspace  of  E defined  by  the  x,  y,  and  z coordir^te  axes. 
Consider  the  projection  of  the  four  - dimensional  convex  hull  onto  this 
subspace.  Denote  this  projection  by  J’j.  Find  a triangular  planar  section 
on  the  surface  of  . This  could  be  done  using  the  methods  of  Chapter  II. 

Denote  the  three  points  that  define  this  planar  surface  feature  of  ^ 

Pp  p^,  and  p^.  Continue  to  Step  2. 

Step  2:  Separation 

Construct  a hyperplane,  to  be  denoted  hp^ , that  contains 
the  points  Pp  p^,  and  p^,  and  is  parallel  to  the  line  This  hyperplane 

4 

separates  the  space  E into  two  half  spaces.  It  also  separates  the  set  A 

into  two  subsets,  denoted  A.  and  A . The  subset  A<  is  the  subset  of  A 

z o t 

that  contains  all  the  points  of  A that  are  in  the  same  half  space  as  the  line 
The  subset  A^  contains  the  remaining  points  of  A. 

Step  3:  Hyperplane 

Find  a fourth  point,  p^  such  that  p^  e.  and  the  hyper- 
plane defined  by  (p,,  Py,  p,,  p.),  to  be  denoted  hp  , is  a tangent  hyperplane 

^ ^ ^ ^ 

to  the  surface  of  the  convex  ^ull  of  the  set  A.  Clearly  a section  of 

hp  will  be  a surface  feature  of 
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Step  4:  Branching 

Determine  whether  the  line  I penetrates  in  the 
interior  of  the  surface  section  defined  by  the  points  (p^,  p^.  p^.  p^)- 
If  so,  this  point  of  penetration  is  the  desired  boundry  point.  Terminate 
the  procedure.  If  not,  continue  to  Step  5, 

Step  5:  Reset 

Discard  the  point  in  the  set  j p^,  p^,  p^  j that  is  "furthest" 
from  the  line  1.  Relabel  the  two  survivers  plus  the  point  p^  as  the  new 
points  pj,  p^i  and  p^.  Return  to  Step  2,  The  form  of  the  distance  measure 
will  be  described  in  the  discussion  below. 

The  algorithm  is  presented  in  block  diagram  form  in  Figure  3.1. 

A more  complete  description  of  the  steps  in  the  algorithm  is  given  below. 

As  the  title  implies,  the  purpose  of  the  first  step  in  the  algorithm 
is  to  determine  an  initial  position  for  the  search  routine.  The  search  routine 
operates  by  finding  a sequence  of  sets  of  four  points  of  the  array  A.  Each 
set  in  this  sequence  j (pj,  p^.  P^,  P^)  | , defines  a hyperplane.  Because 

of  the  method  of  selection  of  the  sets,  thes^  hyperplanes  will  include  a 
section  of  the  surface  of  the  convex  hull  of  the  array  A.  Having  found 
an  initial  surface  section,  the  routine  operates  by  moving  from^this  surface 
section  to  an  adjacent  section.  Travel  across  the  surface  of  s always 
toward  the  line  £.  The  routine  continues  until  a surface  section  that  is 
penetrated  by  the  line  i is  found.  This  point  of  penetration,  the  point  of 
intersection  of  the  line  £ and  the  hyperplane  (p^,  p^.  p^,  P^).  is  the  desired 
bounding  point. 


In  Chapter  II  an  argument  used  in  the  development  of  the  three- 
dimensional  algorithm  was  that  the  convex  hull  of  a projection  of  a set  of 
points  is  equivalent  to  the  projection  of  the  convex  hull  of  the  set  (equation 
(2.4)).  The  three-dimensional  set  of  points,  A^  formed  by  considering  only  the 
X,  y,  and  z coordinate  values  of  the  four-dimensional  set  A = (x,  y,  z,  w)  j , 

is  a three-dimensional  projection  of  A.  Therefore,  a surface  section  of 
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the  three-dimensional  convex  hull  of  A.  will  be  the  three-dimensional 

projection  of  a surface  feature  of  , the  convex  hull  of  A.  Such  a three- 

dimensional  surface  section  can  be  found  by  the  methods  of  Chapter  II, 

Let  the  points  that  define  such  a surface  section  be  denoted  p^,  p^, 

and  pj.  The  plane  (pj,  p^i  p^)  will  define  part  of  the  boundry  of  a hyp- 

erplanar  section  on  the  surface  of  in  [so].  In  Chapter  II  a surface 

chord  was  found  as  a preliminary  step  to  finding  a surface  planar  section 
3 

in  E . Similarly,  a surface  planar  section  has  been  found  as  a preliminary 
step  to  finding  a surface  hyperplanar  section  in  E^. 


The  step  that  assures  that  the  algorithm  will  progress  in  the 
direction  of  the  line  I is  Step  2:  Separation.  In  Step  2,  a hyperplane 

hp  , is  constructed  that  is  parallel  to  the  line  £ and  goes  through  the 

. 4 

points  pp  p^,  and  p^.  This  hyperplane  divides  the  space  E into  two 

half  spaces.  One  of  these,  denoted  E^,  includes  the  line  £.  The  subset 

^ 4 

of  A that  is  defined  by  the  intersection  of  E,  and  the  set  A is  denoted  A.  . 

The  remainder  of  the  set  A is  denoted  A . It  is  clear  that  members  of 

o 

A.  are  "closer"  to  £ in  some  sense  than  are  members  of  A . It  is  from 
* o 

the  membership  of  the  subset  A^  that  the  fourth  point,  p^,  that  defines 
a hyperplanar  section  of  the  surface  #will  be  selected.  Thus,  the  algorithm 
is  assured  of  moving  in  the  direction  of  the  line  £. 


The  hyperplane  hpg  that  defines  a part  of  the  surface  of 
is  found  by  a method  similar  to  the  surface  chord  selection  procedure  intro- 
duced in  Appendix  A.  In  the  search  for  the  lower  bound,  the  hyperplane 
that  is  desired  is  defined  by  the  point  set  (pj,  p^.  p^,  p^)  where  Pj,  p^. 
and  p^  were  found  earlier,  p^  p A^,  and  all  other  points  of  A are  in  or 
above  this  hyperplane  in  z-coordinate  value.  A routine  to  find  such  a 
hyperplane  could  start  by  finding  the  point  in  the  subset  A^  that  has  the 
minimum  z-coordinate  value.  Tentatively  label  this  point  p^.  Tentatively 
label  the  hyperplane  defined  by  (pj,  p^.  p^,  p^^)  as  hp^.  Determine  if 
any  points  of  A^  are  below  hp  in  z-coordinate  value(since  the  planar 
section  defined  by  (pj,  p^,  p^)  is  on  the  surface  of  .>^by  construction, 
the  points  in  A^  can  be  ignored).  Denote  the  subset  of  points  in  A. 
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j that  lie  below  hp  by  B..  If  B . is  empty,  hp  is  the  desired  hyperplane. 

^ If  B.  is  not  empty,  find  the  point  in  B.  with  the  minimum  z-coordinate  value. 

Tentatively  label  this  new  point  p^.  This  defines  a new  tentative  hyperplane 

hp  to  be  tested.  It  is  clear  that  this  routine  will  converge  to  the  desired 

8 

hyperplane  from  the  arguments  presented  in  Appendix  A. 

The  remaining  step  in  the  algorithm  is  the  reset  step.  In  this 
step  three  of  the  four  points  (pj,  p^,  p^,  p^)  are  selected  to  form  the  basis 
for  the  search  for  the  next  hyperplane.  These  will  be  the  three  points 
that  are  "closest"  to  the  line  £ in  a special  sense. 

Let  the  point  of  intersection  between  the  hyperplane  hp^  defined 
by  (p^,  p^,  p^.  p^),  and  the  line  f be  denoted  by  p^.  Consider  the  plane 
defined  by  (p^i  p^  • p_^)  and  the  line  defined  by  (p^,  p^).  Since  both  this  line 
and  this  plane  are  within  the  hyperplane  hp^,  they  will  intersect  ( a line 
and  a plane  do  not  intersect  in  general  in  [30]).  Let  d^  denote  the 
Euclidean  distance  between  the  point  p^  and  the  point  of  intersection 
between  the  line  and  the  plane.  Similarly,  consider  the  plane  (pj^,  p^,  p^) 
and  the  line  (p^,  distance  between  p^  and  the  intersection 

of  this  new  line  and  plane.  A distance  d^  can  be  similarly  defined  using  the 
plane  (p^,  p^,  p^)  and  the  line  (p^,  p^).  The  plane  selected  for  the  next 
iteration  of  the  search  procedure  is  the  plane  associated  with  the  minimum 
value  element  in  the  set  (dj,  d^,  It  noted  that  the  combination  of 

the  plane  (p^  p^,  p^)  and  the  line  (p^,  p^)  need  never  be  considered. 

This  is  because  the  method  of  selection  of  the  point  p^  assures  that  the 
closest  plane  will  be  one  of  those  with  the  point  p_^  as  a part  of  its  definition. 
Infact,  if  p^  was  eliminated  at  this  step,  it  would  cause  the  algorithm  to 
cycle  endlessly. 

This  constitutes  the  essence  of  a demonstration  that  the  algorithm 
will  converge  in  a finite  number  of  iterations.  The  algorithm  considers  only 
surface  sections,  of  which  there  are  a finite  number,  and  is  always  moving 
in  the  direction  of  the  line  1.  Thus,  the  algorithm  must  converge  to  the 
proper  surface  feature  in  a finite  numb(;r  of  iterations. 


Examples  of  Numerical  Results 
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3.  4 

The  algorithm  outlined  in  Section  3.3  has  been  coded  for  general 
purpose  computers  using  the  FORTRAN  IV  programming  language.  A 
printout  of  the  program  is  provided  in  Appendix  G.  Two  sample  runs  were 
made  using  this  program.  These  runs  are  the  four-dimensional  extensions 
of  the  sample  runs  presented  in  Section  2.  5 for  the  three-dimensional 
algorithm. 


The  examples  are  intersymbol  interference  problems.  The 
auxiliary  functions  used  in  obtaining  the  bounds  were  the  second,  fourth, 
and  sixth  powers  of  the  amplitude  of  the  interference.  The  parametric 

equations  for  the  curve  ^ are  ^ 

X = u^  (3.1) 


y = u 


w = u 


= = 2 


Q 


h + u 
o 


Q 


h - u 
o 


(3.  2) 


(3.  3) 


(3.4) 


where  u is  the  value  of  the  amplitude  of  the  intersymbol  interference, 

h is  the  amplitude  of  the  desired  sign,  o is  the  standard  deviation  of  the 
o 

additive  white  Gaussian  noise,  and  Q{-  ) is  the  usual  complementary  error 


where  D represents  the  maximum  possible  amplitude  of  the  intersymbol 
interference. 


As  in  Chapter  II,  the  first  specific  example  is  that  of  a channel 
with  a Chebychev  filter  impulse  response.  The  results  that  are  presented 
in  Table  3.  1 were  obtained  by  approximating  the  curve  ^ , given  parametrically 
by  equations  (3.1)  - (3.4),  by  an  array  A containing  50  points.  These  points 
were  equally  spaced  in  terms  of  the  parameter  u. 

Under  the  general  heading  "Four- Dimensional  Bounds,  " Table  3.  1 
contains  the  upper  and  lower  bounds  that  were  computed  using  the  computer 
program  shown  in  Appendix  G.  Also  shown  under  this  heading  is  the 
difference  between  these  bounds.  The  difference  serves  as  a measure  of 
the  tightness  of  the  four-dimensional  bounding  technique.  For  purposes  of 
comparison,  the  results  computed  with  the  three-dimensional  routine 
(Appendix  F)  that  were  presented  in  Section  2.  5 are  reproduced  in  Table  3.  1. 

As  expected,  the  four-dimensional  upper  bounds  are  lower  than  the  three- 
dimensional  upper  bounds.  Also,  the  four-dimensional  lower  bounds  are 
higher  than  the  three-dimensional  lower  bounds.  This  is  reflected  in  the 
difference  columns.  The  four-dimensional  bounds  are  seen  to  be  as  much 
as  four  orders  of  magnitude  tighter  than  the  three-dimensional  bounds, 
and  typically  about  two  orders  of  magnitude  tighter.  Thus,  there  is  a 
significant  improvement  in  the  tightness  of  the  bounds  that  can  be  expected 
from  the  additional  dimension.  The  corresponding  drawback  is  in  runtime. 

The  four-dimensional  algorithm  of  Appendix  G required  roughly  two  and 
a half  times  as  much  processing  time  as  did  the  three-dimensional  algorithm 
of  Appendix  F.  The  algorithm  presented  in  Appendix  G (the  four-dimensional 
algorithm)  is  not  optimized  in  terms  of  run  time.  Nevertheless,  one  is 
lead  to  expect  that  a sizeable  processing  time  penalty  may  be  required 
for  each  additional  dimension  used  in  the  bounding. 
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The  second  example  is  that  of  a channel  with  a modified  version 
of  a Chebychev  impulse  response.  In  this  example,  the  maximum  distortion, 

D in  expression  (3.6),  is  taken  to  be  three  times  that  of  the  standard 
Chebychev  channel.  The  channel  impulse  response  and  the  other  appropriate 
parameters  are  scaled  accordingly.  This  example  corresponds  to  the  second 
example  discussed  in  Section  2.  5.  f' 
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FOUR- DIMENSIONAL  ROUNDS  THREE-DIMENSIONAL  BOUNDS 


The  numerical  results  are  presented  in  Table  The  results 

in  this  table  are  presented  in  the  same  format  as  the  results  presented 
in  Table  3.1.  For  this  example  of  more  extreme  amounts  of  intersvmbol 
interference,  the  four-dimensional  bounds  can  be  seen  to  be  about  an  order 
of  magnitude  tighter  than  the  three-dimensional  bounds,  over  the  range 
of  signal-to-noise  ratios.  Thus,  this  example  indicates  that  there  is  still 
a significant  advantage  to  be  gained  from  the  higher  dimensional  bounds 
for  the  case  of  severe  intersymbol  interference. 
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Conclusions 
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The  results  presented  in  Section  3.4  demonstrate  the  value  of 
higher  dimensional  bounding  routines.  This  is  that  considerably  tighter 
bounding  results  can  be  obtained  for  some  additional  expense  in  the  form  of 
computer  run  time.  In  the  results  shown  in  Section  3.4,  the  bounds  were 
typically  one  or  two  orders  of  magnitude  tighter  while  computation  time  rose 
by  a factor  of  less  than  three. 

These  results  also  demonstrate  the  efficiency  of  the  four-dimensional 
algorithm.  This  algorithm  systematically  stepped  across  the  surface  of 
the  convex  hull  until  the  appropriate  surface  feature  was  found.  This  was 
accomplished  by  considering  a sequence  of  hyperplanar  surface  features  in 
terms  of  the  sets  of  four  points  that  define  them.  The  algorithm  proceeded 
by  identifying  and  eliminating  the  point  out  of  the  four  point  set  that  was 
"furthest"  from  the  desired  direction  of  travel.  The  eliminated  point 
was  then  replaced  by  an  appropriate  point  that  was  in  the  direction  of 
convergence.  This  new  four  point  set  defined  another  hyperplanar  surface 
feature  that  was  "closer"  to  the  solution  of  the  bounding  problem  than  was 
the  previous  section.  This  procedure  was  repeated  until  convergence  to 
the  solution  of  the  bounding  problem  was  achieved. 


The  extension  to  bounding  problems  of  dimensions  greater  than 
four  seems  clear.  For  a five-dimensional  problem  the  hyperplanes  would 
be  defined  by  sets  of  five  points.  In  a manner  similar  to  the  four-dimensional 
algorithm,  one  of  these  points  that  is  "furthest"  from  the  desired  direction 
of  travel  could  be  identified  and  eliminated.  This  point  could  be  replaced 
with  an  appropriate  point  that  is  "closer"  to  the  solution  of  the  bounding 
problem.  This  would  define  a new  hyperplanar  surface  reaction  that  is 
closer  to  the  solution  of  the  problem.  Clearly,  if  this  procedure  is  repeated 


a sufficient  number  of  times,  the  algorithm  will  converge  to  the  desired 
solution.  It  is  also  clear  that  the  concept  of  stepping  across  the  surface 
of  a convex  hull  by  modifying  the  set  of  points  one  point  at  a time  is  a concept 
that  will  work  independently  from  the  total  number  of  points  in  the  set. 

That  is,  the  procedure  of  stepping  across  the  surface  by  systematically 
going  from  one  surface  feature  to  an  adjacent  on  is  a procedure  that  will 
work  independent  of  the  dimensionality  of  the  problem. 
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An  important  point  to  investigate  is  the  relationship  between 
problem  dimension  and  algorithm  runtime.  This  is  a difficult  problem, 
but  some  insight  can  be  gained  from  the  form  of  the  four-dimensional 
algorithm. 


In  order  to  determine  whether  this  desired  solution  has  been 

found,  the  algorithm  must  compute  the  point  of  intersection  of  a hyperplane 

4 

and  the  line  1.  In  E , this  amounts  to  inverting  a 4 x 4 matrix.  In  an 
extension  to  a K-dimensional  problem,  it  would  mean  inverting  a K x K 
matrix.  The  niave  method  of  inverting  a K x K matrix  (straightforward 
use  of  the  method  of  cofactors)  would  require  more  than  2(K!)  multiplications. 
While  more  sophisticated  numerical  methods  would  undoubtedly  require 
fewer  multiplications,  it  appears  that  run  time  can  be  expected  to  increase 
very  quickly  as  the  dimensionality  of  the  problem  increases.  Fortunately, 
the  numerical  results  presented  here  appear  to  indicate  the  extensions 
to  very  high  dimensionality  will  rarely  be  necessary.  This  is  because  the 
bounding  results  appear  to  tighten  very  quickly  with  increasing  problem 
dimension. 
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Appendix  A 


Algorithm 


An  algcirithm  for  finding  tiie  chord  Ch  as  required  in  Stop  1 


and  Step  3 is  given  below. 


a)  Divide  the  set  A„  into  two  subsets.  Denote  these  subsets 
L R L ^ 

A„  and  A^.  Assign  to  A„  all  points  of  A that  are  to  the  left  of  the  line 

f 1?  A 

£p.  Assign  all  remaining  points  to  the  set  Ap. 


L R 

b)  In  each  of  the  sets  A„  and  A_,  find  the  point  whose  z-coordinate 

r r 

value  is  the  minimum.  If  the  minimum  z-coordinate  value  in  either  or 


both  subsets  is  not  unique,  select  the  minimum  point  or  points  that  are 

closest  to  the  line  i . Designate  the  resulting  point  in  A^  by  p^,  and  the 

R R ^ ^ ^ 

point  in  Ap  by  Pp. 


c)  Consider  the  line  in  the  plane  F defined  by  the  two  points 
p^  and  p^.  If  there  are  no  points  of  A_  below  this  line,  the  chord  defined 

^ I ^ R 

by  Pp  ;ind  Pp  is  the  desired  chcird  Cdi  p.  In  this  c.ise,  termtnati-  the 
search.  If  there  are  points  of  Ap  below  this  line,  contine  to  d). 


d)  Consider  the  points  of  the  set  A_  that  are  below  the  line 

r 

defined  by  the  points  Pp  and  Pp.  Denote  these  points  as  the  set  Bp.  Let 

!_/  R 

denote  the  intersection  of  the  sets  B_  and  A™.  Similarly,  let  B denote 
r r r r 

R I-» 

the  intersection  of  the  sets  Bp  and  Ap.  Fynd  the  point  in  the  set  Bp 

whose  z-coordinate  value  is  the  minimum.  Let  this  new  point  assume  the 

designation  Pp*  If  Bp  is  empty,  the  designation  Pp  remains  unaltered. 

R 

Similarly,  find  the  point  in  the  set  Bp  whose  z-coordinate  value  is  the 

R R 

minimum.  Let  this  point  assume  the  designation  Pp.  If  Bp  is  empty, 

R 

the  designation  p remains  unaltered.  Return  to  c)  with  the  modified 
F 

pair  of  points  (Pp,  Pp)* 
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Discussion 


This  algorithm  is  demonstrated  to  terminate  with  the  proper 
chord  in  a finite  number  of  steps  by  the  following  argument: 

Let  I stand  for  the  line  and  Ch  stand  for  the  chord  defined 
^ L R ^ 

by  the  pair  of  points  (Pj^t  p„)  that  are  considered  at  step  c)  of  the  algorithm. 

r r 

Similarly,  let  stand  for  the  line  and  Ch^  stand  for  the  chord  defined 

by  the  new  pair  of  points  found  in  step  d)  of  the  algorithm.  If  the 

algorithm  did  not  continue  to  step  d),  then  all  of  the  points  of  Ap  are  on 

or  above  the  line  I . This  means  that  the  chord  Ch  is  on  the  boundry  of 
c _ c 

r'ft  the  convex  hull  of  But  by  construction,  Ch  is  intercepted 

r r c 

by  the  line  f _.  Therefore,  Ch  is  the  chord  that  is  desired.  The  chord 
r c 

Ch  will  be  labeled  Ch„  by  the  algorithm  at  step  c)  and  the  algorithm  will 
c r 

terminate.  If  the  algorithm  continues  to  step  d),  then  there  are  points  of 

A that  lie  below  the  line  £ . In  this  case,  at  least  one  of  the  end  points 
F*  c 

of  the  chord  Ch  , must  be  below  the  line  £ . But  then  the  interior  of  the 
d c 

chord  Ch  , must  be  strictly  below  the  interior  of  the  chord  Ch  . In  particular 

u C 

the  point  at  which  Ch^  intercepts  the  line  £p,  denoted  p^,  must  be  lower  in 
z-coordinate  value  than  the  intercept  between  £p  and  Ch^,  denoted  p^. 

These  ideas  are  illustrated  in  Figure  A.  1. 


r — ■ 

! Thus,  with  each  pass  through  step  d),  the  point  p^  must  be  lowered  in 

I z-coordinate  value.  This  means  that  this  algorithm  cannot  cycle  back 

it  L R 

' ^ to  old  pairs  of  points  (p_,  Pt;,).  This  is  because  the  z-coordinate  value  of 

; the  intercept  point,  p^,  is  strictly  decreasing.  Since  the  set  has  a 

[ finite  number  of  elements,  the  search  must  terminate  in  a finite  number  of 

\ operations.  It  would  be  expected  that  the  termination  would  typically  occur 

I 

‘ after  a small  number  of  iterations. 


4a 


By  construction,  the  three  points  p.  , p^  , and  p,  , project 


i onto  the  plane  as  three  points  on  the  line  which  has  the  chord  Chp  as  a 

! ‘ i 

1 line  segment.  Therefore,  all  points  in  the  plane  defined  by 

Li  C R 

(p.  , p.  , p.  ) will  project  onto  the  plane  F.  as  points  on  this  line.  This 

L C R 

implies  that  the  plane  (p^^  , p^  , p^  ) is  normal  to  the  plane  F.^. 

If  a plane  is  rotated  about  an  axis  normal  to  itself,  the  orientation 
3 

of  the  plane  in  E remains  unchanged.  The  only  effect  is  to  alter  the  positions 

of  the  points  within  the  plane  relative  to  a fixed  coordinate  system.  In 

Lj  C R 

particular,  the  plane  (p.  , p.  , p.  ) can  be  rotated  about  a line  normal  to 
it  until  the  chord  Ch.  is  normal  to  the  plane  F. . Such  a rotation  must 

i i 

be  possible  since  the  rotation  will  not  effect  the  normality  of  the  planes  with 
respect  to  each  other.  When  the  chord  Ch.  is  normal  to  the  plane  F., 
it  will  project  as  a single  point  on  F^.  This  new  orientation  of  the  points 
' of  the  set  A will  yield  the  new  projection  denoted  ^ ^ , and  the  chord 

Ch^  will  be  said  to  have  been  "collapsed". 


Appendix  C 

By  construction,  the  chord  Ch.  ^ is  "collapsed"  in  the  pro- 
jection F,.  Since  all  points  of  the  chord  Ch\  ^ project  as  a single 
point  on  F.,  and  since  Ch^  and  Ch.  j share  an  end  point,  the  plane 
defined  by  these  two  connected  chords  projects  on  the  plane  F^  as  the  line 

of  which  the  chord  Ch_  is  a line  segment.  But  by  construction,  all  points 

r . 

I 

of  the  set  A lie  in  or  above  this  plane.  This  means  that  the  plane  defined  by 
the  chords  Ch.  and  Ch.  , is  a support  plane  [22]  of  , the  convex 
hull  of  the  set  A.  This  plane  defines  part  of  the  surface  of  . Thus, 
the  two  connected  chords  Ch.  and  Ch.  , define  a triangular  planar  section 
on  the  surface  of  tJV  . 

The  line  i will  intersect  the  surface  of  jTin  two  points.  This 
is  a consequence  of  the  Isomorphism  Theorem.  One  of  these  points  will 
determine  the  value  of  the  upper  bound,  and  the  other  will  determine  the 
value  of  the  lower  bound.  If  the  line  I and  the  surface  triangular  planar 
section  defined  by  Ch.  and  Ch^  ^ have  a point  in  common,  it  must  be  one 
of  these  two  bounding  points.  Because  of  procedure  that  was  used  to  select 
the  chords  Ch.  and  Ch.  ,,  it  will  be  the  lower  bound. 

i 1-1 

It  can  be  seen  that  the  plane  defined  by  the  chords  Ch.  and 

L C R ^ 

Ch.^  ^ and  the  plane  defined  by  the  points  (p^  , p.  , p.  ) both  project 

as  the  same  line  on  the  plane  F. . Thus,  these  planes  are  identical. 

C *' 

Since  the  point  p.  is  a point  of  the  line  I and  also  a point  of  the  support 
plane,  if  it  lies  within  the  triangular  planar  section  defined  by  Ch^  and  Ch.  ^ 
it  must  be  the  bounding  point  that  is  desired. 
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Appendix  D 

C C 

If  p.  * p.  both  chords  Ch.  an^  Ch^  are  parts  of  the  boundry 

of  the  same  planar  face  on  the  surface  of  This  statement  is  justified 

by  the  arguments  given  below. 

Lj  C R 

Consider  the  plane  defined  by  (p^  _ p.  _ p.  _ j )•  By 

construction,  all  points  of  A are  either  in  or  above  this  plane.  In  the 

L C 

projection  F. , this  plane  projects  as  the  line  (pp  , Pp  ).  Thus, 

'■  i - 1 i - 1 

in  the  F.  projection,  all  points  of  Ap  must  be  on  or  above  the  line 

T C ^ 

(Pp  , Pp  ).  In  particular,  the  points  of  the  chord  Chp  must  be 

i'^i'llj  C ^ 

on  or  above  the  line  (p„  , p„  ).  But  clearly  the  point 

r . 1 r . 1 

i - 1 i - 1 

C 1j  c c 

Pp  is  on  the  line  (pp  , Pp  ).  Thus,  the  point  pp  must  be 

i.“l  i”  li”l  ^ i 

equal  to  or  above  (in  z-coordinate  value)  the  point  Pp 


Lj  R 

If  either  of  the  points  Pp  and  Pp  that  define  the  chord  Chp 

I_i  R ^ ^ C ^ 

are  above  the  line  (p„  , p„  ),  the  point  p„  must  be  above  the 

r . 1 r . 1 r . 

1-1  1-1  I 

c c c 

point  Pp  . Thus,  if  Pp  * Pp  ’ ^^F 
i - 1 i - 1 i i 

(pp  , Pp  ).  But  then  the  planes  (p^_  2’  P^^.  l’  p[^-  l^ 

i - 1 i - 1 

Li  C R 

(p.  , p.  , p.  ) will  both  project  as  the  same  line  on  Fp  Thus,  these  planes 
will  be  identical.  Therefore,  by  arguments  similar  to  those  of  Appendix  C, 
Ch.  and  Ch.  , will  be  chords  on  the  boundry  of  the  same  planar  face  on 
the  surface  of  t/f  . 


I 


Appendix  E 

The  arguments  presented  b^low  show  that  the  algorithm  will 
converge  to  the  appropriate  face  of 

As  was  established  in  Appendix  D,  the  sequence  of  points 
j p9  I is  non-decreasing.  Thus,  the  algorithm  canncn  cycle.  Since^ 
it  can  never  return  to  previously  considered  faces  of  , and  since  has 
a finite  number  of  faces,  the  algorithm  must  converge  to  the  appropriate 
face  in  a finite  number  of  steps. 


Appendix  F 

This  Appendix  contains  a listing  of  a FORTRAN  IV  computer 
program  that  solves  the  three-dimensional  moment  bounding  problem. 
This  program  is  based  on  the  algorithm  described  in  Chapter  11. 
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Appendix  G 


This  Appendix  contains  a listing  of  a FORTRAN  IV  computer 
program  that  solves  the  four-dimensional  moment  bounding  problem. 
This  program  is  based  on  the  algorithm  described  in  Chapter  III. 
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